Tension gestuelle en co-présence d'un accent d'intensité

National audienceSelon McNeill (1992) (2005), gestes co-verbaux et parole émergent d'une même source cognitive et forment un ensemble indivisible dans la communication linguistique. Cette proposition, déjà relativement ancienne, a trouvé un écho dans des travaux plus récents de sciences cognitives, dans les courants de cognition dite " située " (Barsalou, 2008) et " incarnée " (Iverson & Thelen, 1999) pour qui l'activité cognitive se nourrit de l'environnement (le contexte) et de propriétés proprioceptives. La communication linguistique relève à la fois des modalités vocales et gestuelles, tant sur le plan segmental que sur le plan supra-segmental, et il est donc naturel de trouver des caractéristiques communes d'une activité linguistique dans les deux modalités. Dans cet article, nous étudions les liens entre un trait supra-segmental vocal (l'accent d'intensité) et un trait supra-segmental gestuel (la tension de la main) lorsque geste et accent d'intensité sont produits simultanément

Penser tout haut. Analyse multimodale de fins de séquences conversationnelles

National audienceThis paper proposes a multimodal analysis of thoughts spoken out loud by which speakers show some degree of inattention to the current conversation. The sequences under study have been detected in the video files of conversational CID, recorded at the LPL, mainly thanks to the unfocused and fixed gaze of speakers. An analysis showed that all the sequences under study share prosodic properties (in terms of F0 and intensity range and span ; presence of pause before and after the sequences). Gesturally speaking the speakers' fixedness of gaze is paralleled by a completely relaxed attitude of the body and absence of any hand gesture. A discourse analysis of the utterances shows that they are all post-closing sequences (rather than closing sequences proper) and that they appear before a topic change.Cet article propose une analyse multimodale des productions orales relevant de la pensée à voix haute par laquelle le locuteur montre un certain degré d'inattention à la tâche conversationnelle en cours. L'étude porte sur des séquences vidéo tirées du corpus CID, enregistré au Laboratoire Parole et Langage

Les pauses démarcatives déplacées en anglais spontané. Marquage kinésique et prosodique

Nous étudions, dans le cadre de notre thèse, les interactions entre intonation et gestualité en anglais spontané, et la manière dont se gèrent les tours de parole entre les interlocuteurs. Dans cet article, nous allons montrer comment les locutrices de note corpus transgressent les règles syntaxiques (en déplaçant la pause démarcative), en utilisant la prosodie et la gestualité pour empêcher l'interlocutrice de prendre la parole. La pause démarcative constitue en effet un danger pour les locuteurs, dans la mesure où elle indique une frontière, et éventuellement une fin de tour de parole. Ici, les locutrices placent la frontière non pas entre les deux groupes syntaxiques, mais après le mot-outil, qui introduit le deuxième groupe

Discursive, Prosodic and Gestural Analysis of Focalisation Pauses in British English

International audienceIn this paper, our intention is to analyse the marking of focalisation pauses in a videotaped corpus of British conversation. Our analysis will be three-dimensional : we will first describe the acoustic characteristics of the pauses and of the tone-units they separate, in order to show the differences between these pauses and other pauses such as demarcative or hesitation pauses. This analysis will include the following parameters : length of pause and rate of speech of the distinct tone-units, F0 movements and intensity before and after the pause. We will then try to see what kind of gestuality is implied in the case of focalisation and will propose a discursive analysis of the context in which the pauses appear

Les pauses démarcatives déplacées en anglais spontané. Marquage kinésique et prosodique

Nous étudions, dans le cadre de notre thèse, les interactions entre intonation et gestualité en anglais spontané, et la manière dont se gèrent les tours de parole entre les interlocuteurs. Dans cet article, nous allons montrer comment les locutrices de note corpus transgressent les règles syntaxiques (en déplaçant la pause démarcative), en utilisant la prosodie et la gestualité pour empêcher l'interlocutrice de prendre la parole. La pause démarcative constitue en effet un danger pour les locuteurs, dans la mesure où elle indique une frontière, et éventuellement une fin de tour de parole. Ici, les locutrices placent la frontière non pas entre les deux groupes syntaxiques, mais après le mot-outil, qui introduit le deuxième groupe

Timing Relationships between Speech and Co-Verbal Gestures in Spontaneous French

International audienceSeveral studies have described the links between gesture and speech in terms of timing, most of them concentrating on the production of hand gestures during speech or during pauses (Beattie & Aboudan, 1994; Nobe, 2000). Other studies have focused on the anticipation, synchronization or delay of gestures regarding their co-occurrence with speech (Schegloff, 1984; McNeill, 1992, 2005; Kipp, 2003; Loehr, 2004; Chui, 2005; Kida & Faraco, 2008; Leonard and Cummins, 2009) and we would like to participate in the debate in the present paper. We studied the timing relationships between iconic gestures and their lexical affiliates (Kipp, Neff et al., 2001) in a corpus of French conversational speech involving 6 speakers and annotated both in Praat (Boersma & Weenink, 2009) and Anvil (Kipp, 2001). The timing relationships we observed concerned the position of the gesture stroke as compared to that of the lexical affiliate and the Intonation Phrase, as well as the position of the gesture Phrase as regards that of the Intonation Phrase. The main results show that although gesture and speech are co-occurring, gestures generally start before the related speech segment

Gesture catchments and density in narratives of personal experience

International audienceThe aim of the present paper is to extend the studies on spontaneously produced narratives, that is narratives of personal experience produced in a larger speech context (video-recorded conversations, TV shows, etc.). Although the work is based on a larger collection of narratives, for the sake of clarity, one complex narrative will be presented here and it will be shown that intonation units are probably more adapted than syntactic ones to determine the Labovian phases of a spoken narratives and that both modal density (Norris 2004) and gesture catchments adapt to the complexity of a narrative

Timing Relationships between Speech and Co-Verbal Gestures in Spontaneous French

International audienceSeveral studies have described the links between gesture and speech in terms of timing, most of them concentrating on the production of hand gestures during speech or during pauses (Beattie & Aboudan, 1994; Nobe, 2000). Other studies have focused on the anticipation, synchronization or delay of gestures regarding their co-occurrence with speech (Schegloff, 1984; McNeill, 1992, 2005; Kipp, 2003; Loehr, 2004; Chui, 2005; Kida & Faraco, 2008; Leonard and Cummins, 2009) and we would like to participate in the debate in the present paper. We studied the timing relationships between iconic gestures and their lexical affiliates (Kipp, Neff et al., 2001) in a corpus of French conversational speech involving 6 speakers and annotated both in Praat (Boersma & Weenink, 2009) and Anvil (Kipp, 2001). The timing relationships we observed concerned the position of the gesture stroke as compared to that of the lexical affiliate and the Intonation Phrase, as well as the position of the gesture Phrase as regards that of the Intonation Phrase. The main results show that although gesture and speech are co-occurring, gestures generally start before the related speech segment

Relations temporelles entre parole et gestualité co-verbale en français spontané

National audienceSeveral studies have described the links between gesture and speech in terms of timing, most of them concentrating on the production of hand gestures during speech or during pauses (Beattie & Aboudan [1]; Nobe [16]). Other studies have focused on the anticipation or delay of gestures regarding their co-occurrence with speech (Schegloff [18]; McNeill [15]; Chui [6]; Kida & Faraco [9]; Leonard and Cummins [13]) and we would like to take part in the debate in the present paper. We studied the timing relationships between iconic gestures and their lexical affiliates (Kipp, Neff et al. [11]) in a corpus of French conversational speech involving 6 speakers and annotated both in Praat (Boersma & Weenink [4]) and Anvil (Kipp [10]).Cet article traite des relations temporelles entre gestes iconiques et affiliés lexicaux et les résultats montrent une anticipation du geste sur la parole tant au niveau lexical qu'au niveau du groupe intonatif

Gesture and Speech in Interaction - 4th edition (GESPIN 4)

International audienceThe fourth edition of Gesture and Speech in Interaction (GESPIN) was held in Nantes, France. With more than 40 papers, these proceedings show just what a flourishing field of enquiry gesture studies continues to be. The keynote speeches of the conference addressed three different aspects of multimodal interaction:gesture and grammar, gesture acquisition, and gesture and social interaction. In a talk entitled Qualitiesof event construal in speech and gesture: Aspect and tense, Alan Cienki presented an ongoing researchproject on narratives in French, German and Russian, a project that focuses especially on the verbal andgestural expression of grammatical tense and aspect in narratives in the three languages. Jean-MarcColletta's talk, entitled Gesture and Language Development: towards a unified theoretical framework,described the joint acquisition and development of speech and early conventional and representationalgestures. In Grammar, deixis, and multimodality between code-manifestation and code-integration or whyKendon's Continuum should be transformed into a gestural circle, Ellen Fricke proposed a revisitedgrammar of noun phrases that integrates gestures as part of the semiotic and typological codes of individuallanguages. From a pragmatic and cognitive perspective, Judith Holler explored the use ofgaze and hand gestures as means of organizing turns at talk as well as establishing common ground in apresentation entitled On the pragmatics of multi-modal face-to-face communication: Gesture, speech andgaze in the coordination of mental states and social interaction.Among the talks and posters presented at the conference, the vast majority of topics related, quitenaturally, to gesture and speech in interaction - understood both in terms of mapping of units in differentsemiotic modes and of the use of gesture and speech in social interaction. Several presentations explored the effects of impairments(such as diseases or the natural ageing process) on gesture and speech. The communicative relevance ofgesture and speech and audience-design in natural interactions, as well as in more controlled settings liketelevision debates and reports, was another topic addressed during the conference. Some participantsalso presented research on first and second language learning, while others discussed the relationshipbetween gesture and intonation. While most participants presented research on gesture and speech froman observer's perspective, be it in semiotics or pragmatics, some nevertheless focused on another importantaspect: the cognitive processes involved in language production and perception. Last but not least,participants also presented talks and posters on the computational analysis of gestures, whether involvingexternal devices (e.g. mocap, kinect) or concerning the use of specially-designed computer software forthe post-treatment of gestural data. Importantly, new links were made between semiotics and mocap data